McGinn & Gibb, PLLC 
A Professional Limited Liability Company 
Patents, Trademarks, Copyrights, and Intellectual Property Law 
8321 Old Courthouse Rd, Suite 200 
Vienna, Virginia 22182-3817 
Telephone (703) 761-4100 
Facsimile (703) 761-2375 



APPLICATION 
FOR 
UNITED STATES 
LETTERS PATENT 



APPLICANT: Tomoko Fujita 

FOR: DATA TRANSMISSION SYSTEM USING AT 
CELLULAR PHONES 

DOCKET NO.: DP-748 US 



DATA TRANSMISSION SYSTEM USING AT CELLULAR PHONES 

BACKGROUND OF THE INVENTION 
The present invention relates to a data transmission system 
using at cellular phones, in particular, in which video data and audio 
data are transmitted. 
5 Description of the Related Art 

Cellular phones have rapidly become popular and various 
functions have been added to the cellular phones, and the usability of the 
cellular phones by users has become high. The Japanese Patent 
Application Laid-Open No. HEI 8-70363 discloses a transmitter and 

10 receiver of data multiplexed video and audio data. Generally, when 
both video data and audio data are transmitted at the same time through 
a telephone circuit being a narrow band transmission line to a cellular 
phone, both of video quality and audio quality are deteriorated. In 
order to solve this problem, at this application, when an audio level of the 

15 audio data is lower than a designated level, only the video data are 
transmitted, and when the audio level of the audio data is higher than 
the designated level, transmission of the video data is stopped and only 
the audio data are transmitted. For achieving this, at this application, 
a compressed video data outputting means, a compressed audio data 

20 outputting means, a transmitting means, and a manual switch for 
switching the output of the transmitting means are provided. And the 
transmitting means provides a data transmission control means, a 
switching means, a data switched to video data generating means, a data 
switched to audio data generating means, and a transmitting data 

25 storing means. 

However, at the conventional technology mentioned above, 
when the audio level being more than the designated level is detected, 
the transmission of the video data is stopped and only the audio data are 



* • 

transmitted. Therefore, there is a problem that the transmission of the 
video data is frequently stopped, because the transmission of the video 
data is stopped even when a single sound such as noise is generated or a 
conversation for a short time is executed. Consequently this causes 
5 that the communication at the video and audio data telecommunication 
is interrupted. 

SUMMARY OF THE INVENTION 
It is therefore an object of the present invention to provide a 

10 data transmission system using at cellular phones, in which existing 
transmission lines having a designated transmission capacity can be 
used efficiently, and the quality of video and audio data to be transmitted 
can be improved. 

According to the present invention, there is provided a data 

15 transmission system using at cellular phones. The data transmission 
system using at cellular phones provides a video data encoder that 
encodes inputted video data, an audio data encoder that encodes inputted 
audio data, video data storage that stores encoded video data outputted 
from the video data encoder, audio data storage that stores encoded 

20 audio data outputted from the audio data encoder, and a multiplexer 
that multiplexes smoothed video data outputted from the video data 
storage and smoothed audio data outputted from the audio data storage, 
and transmits multiplexed video and audio data. And the data 
transmission system using at cellular phones further provides an audio 

25 signal detector which audio signals of the inputted audio data and an 
audio input switch signal are inputted to, and a multiplexing controller. 
And the audio signal detector measures audio levels of the inputted 
audio signals and generates a data write control signal for controlling the 
video data encoder and the audio data encoder and also generates an 

30 audio detected signal for controlling the multiplexing controller. And 




the multiplexing controller generates a data read control signal for 
controlling the video data storage and the audio data storage, and also 
generates a data multiplexing control signal for controlling the 
multiplexer. 

5 According to the present invention, the audio signal detector 

measures changes of the audio levels of the inputted audio signals in the 
passage of time. And the audio signal detector judges whether the 
audio levels exceeded predetermined one or more levels or not, and 
further measures one or more periods that the audio levels exceeded the 

10 predetermined one or more levels. 

According to the present invention, the audio signal detector 
and the multiplexing controller work to transmit only the inputted video 
data regardless of the audio levels of the inputted audio signals, at the 
case that the audio input switch signal is OFF. And the audio signal 

15 detector and the multiplexing controller, at the case that the audio input 
switch signal is ON, work to control the encoded video data and a 
transmission bit rate of the encoded audio data in plural cases whether 
the audio levels of the inputted audio signals exceeded one or more 
predetermined levels and continued for one or more predetermined 

20 periods. 

BRIEF DESCRIPTION OF THE DRAWINGS 
The objects and features of the present invention will become 
more apparent from the consideration of the following detailed 
25 description taken in conjunction with the accompanying drawings in 
which- 

Fig. 1 is a block diagram showing a structure of a data 
transmission system using at cellular phones of the present invention; 

Fig. 2 is a flowchart showing an output data controlling 
30 method at an audio signal detector at the embodiment of the data 



transmission system using at cellular phones of the present invention; 

Fig. 3 is a diagram showing a waveform of audio input signals 
and a relation among an audio input switch signal, the audio input 
signals, an audio detected signal, a framing signal, and output data, at 
5 the embodiment of the data transmission system using at cellular phones 
of the present invention. 

DESCRIPTION OF THE PREFERRED EMBODIMENT 

Referring now to the drawings, an embodiment of the present 

10 invention is explained in detail. Fig. 1 is a block diagram showing a 
structure of a data transmission system using at cellular phones of the 
present invention. The data transmission system using at cellular 
phones of the present invention consists of a video data input terminal 11, 
an audio data input terminal 12, a video data encoder 13, an audio data 

15 encoder 14, video data storage 15, audio data storage 16, an audio signal 
detector 17, a multiplexing controller 18, a multiplexer 19, and a data 
output terminal 20. 

The video data encoder 13 encodes video data inputted from 
the video data input terminal 11. The video data storage 15 stores 

20 video data encoded at the video data encoder 13. The audio data 
encoder 14 encodes audio data inputted from the audio data input 
terminal 12. The audio data storage 16 stores audio data encoded at 
the audio data encoder 14. The audio signal detector 17 always 
measures electric power of audio signals inputted from the audio data 

25 input terminal 12 and calculates their audio levels in the passage of time. 
And further the audio signal detector 17 outputs an audio detected signal 
le to the multiplexing controller 18 and a data write control signal Id to 
the video data encoder 13 and the audio data encoder 14, based on the 
changes of the calculated audio levels in the passage of time and an 

30 audio input switch signal lj. The multiplexing controller 18 is 



controlled by the audio signal detector 17 and controls so that output 
data from the video data storage 15 and the audio data storage 16 are 
smoothed and also controls the multiplexer 19. The multiplexer 19 
receives a data multiplexing control signal li from the multiplexing 
5 controller 18, and multiplexes smoothed video data If from the video 
data storage 15 and smoothed audio data lg from the audio data storage 
16, and outputs multiplexed data to the data output terminal 20. And 
the data output terminal 20 outputs output data la. 

Next, referring to Fig. 1, operation of the data transmission 

10 system using at cellular phones of the present invention is explained. 
Video data inputted from the video data input terminal 1 1 are encoded to 
digital data having a designated bit number at the video data encoder 13, 
and encoded video data lb are outputted. And audio data inputted from 
the audio data input terminal 12 are encoded to digital data having a 

15 designated bit number at the audio data encoder 14, and encoded audio 
data lc are outputted. And the audio data inputted from the audio data 
input terminal 12 are also inputted to the audio signal detector 17 as 
audio signals. The audio signal detector 17 always measures electric 
power of the audio signals inputted from the audio data input terminal 

20 12. And the audio signal detector 17 outputs a data write control signal 
Id, which instructs the video data encoder 13 and the audio data encoder 
14 to write the encoded video data lb in the video data storage 15 and 
the encoded audio data lc in the audio data storage 16. And also the 
audio signal detector 17 outputs an audio detected signal le to the 

25 multiplexing controller 18, based on the changes of the audio levels in 
the passage of time and an audio input switch signal lj. The 
multiplexing controller 18 outputs a data read control signal lh to the 
video data storage 15 and the audio data storage 16 based on the audio 
detected signal le from the audio signal detector 17. The video data 

30 storage 15 outputs smoothed video data If to the multiplexer 19 based on 
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the data read control signal lh. And the audio data storage 16 outputs 
smoothed audio data lg to the multiplexer 19 based on the data read 
control signal lh. And the multiplexing controller 18 outputs a data 
multiplexing control signal li to the multiplexer 19 that controls whether 

5 data to be multiplexed are the video data and/or the audio data. The 
multiplexer 19 selects the video data and/or the audio data to be 
transmitted based on the data multiplexing control signal li from the 
multiplexing controller 18, and generates frames and multiplexes the 
selected data, and outputs multiplexed data to the data output terminal 

10 20. And the data output terminal 20 outputs output data la. 

Next, referring to Figs. 2 and 3, a telecommunication control 
method of the video and audio data based on the audio signal detection at 
the audio signal detector 17 is explained. Fig. 2 is a flowchart showing 
an output data controlling method at the audio signal detector 17 at the 

15 embodiment of the data transmission system using at cellular phones of 
the present invention. Fig. 3 is a diagram showing a waveform of audio 
input signals 22 and a relation among an audio input switch signal 21 ( 
lj ), the audio input signals 22, an audio detected signal 23 ( le ), a 
framing signal 24, and output data 25 ( la ) at the embodiment of the 

20 data transmission system using at cellular phones of the present 
invention. In this explanation, the step number is the number shown in 
Fig.2. 

First, the audio signal detector 17 receives audio input signals 
22 from the audio data input terminal 12 (step Al). Electric power of 

25 the audio input signals 22 (shown in Fig. 3 (b)) is always measured at the 
audio signal detector 17 and their audio levels are calculated. Next, an 
audio input switch signal 21 ( lj ) (shown in Fig. 3 (a)) is judged to be ON 
(H level) or OFF (L level) (step A2). At the case that the audio input 
switch signal 21 ( lj ) is OFF (step A2, SW:OFF), the state S is made to 

30 be So signifying that the audio data are not transmitted (step A3). At 



this time, the output data is only video data. 

Next, when the audio input switch signal 21 ( lj ) is switched 
to ON from OFF (step A2, SW^ON), it is judged whether the current state 
S is Si or not (step A4), in this, the state Si signifies the state that the 

5 audio data are not transmitted and only the video data are transmitted 
at the audio input switch signal 21 ( lj ) is ON. At the case that the 
current state S is Si (YES at the step A4), it is judged whether the 
calculated audio levels exceeding a designated level Thl, which is a level 
being recognized as a sound, continued for over a time tl or not (step A5). 

10 At the case that the calculated audio levels did not exceed the designated 
level Thl or the calculated audio levels exceeding the designated level 
Thl did not continued for over the time tl (NO at the step A5), the state 
S is still Si (step A6). At this case of the state Si, it is judged that the 
audio data were not inputted, and only the video data are transmitted. 

15 At the case that the calculated audio levels exceeding the designated 
level Thl continued for over the time tl (YES at the step A5), the state S 
is made to be S2 (step A10), and the audio data being a low bit rate and 
the video data are transmitted. 

Next, it is judged whether the current state S is S2 or not (step 

20 A7). At the case that the current state S is S2 (YES at the step A7), it is 
judged whether the detected audio levels exceeding a designated level 
Th2 continued for over a time t2 (step A8). At the case that this judged 
result is YES at the step A8, the current state S is made to be S3, and 
only audio data being a high bit rate are transmitted (step A13). At the 

25 case that this judged result is NO at the step A8, when the audio levels 
not exceeding the designated level Thl did not continue for over a time t4 
(NO at step A9), the state S is still S2 (step the AlO). And at the case 
that the audio levels not exceeding the designated level Thl continued 
for over the time t4 (YES at the step A9), it is judged that a sound was 

30 not detected and the state S is made to be SI (the step A6). Next, it is 



judged whether the current state S is S3 or not (step All). At the case 
of YES at the step All, it is judged whether the audio levels not 
exceeding the designated level Th2 continued for over a time t3 or not 
(step A12). At the case of NO at the step A12, the state S is still S3 (the 
5 step A13). At the case of YES at the step A12, that is, the audio levels 
not exceeding the designated level Th2 continued for over the time t3, the 
state S is made to be S2 (the step A10). As mentioned above, the 
telecommunication control of the video and audio data are executed 
based on the judged results of the changes of the audio levels, inputted to 

10 the audio data input terminal 12, in the passage of time. In this, as 
shown in Fig. 3, that an audio level exceeds the designated level Thl or 
Th2 signifies that the audio level exceeds either upper line or lower line 
of the designated level Thl or Th 2 in the upward direction or the 
downward direction. 

15 Referring to Fig. 3, signals and data at the present invention 

are explained in more detail. In Fig. 3, ( a ) signifies the audio input 
switch signal 21 (audio input switch signal lj in Fig. l) that is inputted 
to the audio signal detector 17 shown in Fig. 1, ( b ) signifies the audio 
input signals 22 that are inputted to the audio data input terminal 12 

20 shown in Fig. 1 as audio signals, ( c ) signifies an audio detected signal 23 
(the audio detected signal le in Fig. l) that is outputted to the 
multiplexing controller 18 from the audio signal detector 17 shown in Fig. 
1. Further, in Fig. 3, ( d ) signifies a framing signal 24 that is generated 
at the multiplexer 19 shown in Fig. 1, and ( e ) to ( h ) signify output data. 

25 The ( e ) is output data 25 (output data la shown in Fig. l) , ( f ) signifies 
output data at the time when the state S is So and Si, ( g ) signifies 
output data at the time when the state S is S2, and ( h ) signifies output 
data at the time when the state S is S3. As mentioned above, Fig. 3 
shows operation and output data at the time when the audio input 

30 switch signal 21 and the audio input signals 22 shown in ( a ) and ( b ) 



are inputted to the audio signal detector 17 shown in Fig. 1. 

Next, referring to Figs. 1 and 3, operation of the embodiment of 
the data transmission system using at cellular phones of the present 
invention is explained. First, the audio input signals 22 ( b ) are 
5 inputted from the audio data input terminal 12. When the audio input 
switch signal 21 ( lj ) is OFF (L level), the state of the audio detected 
signal 23 ( le ) is So. And only the encoded video data lb from the video 
data encoder 13 are written in the video data storage 15 by the data 
write control signal Id from the audio signal detector 17. Writing 

10 operation of the encoded audio data lc to the audio data storage 16 from 
the audio data encoder 14 is stopped. The multiplexing controller 18 
makes the video data storage 15 read out the smoothed video data If to 
the multiplexer 19 by using the data read control signal lh based on the 
audio detected signal le, and also outputs the data multiplexing control 

15 signal li to the multiplexer 19. The multiplexer 19 generates the 
framing signal 24 ( d ) that adds a video and/or audio identification 
signal to the header of the data and generates frames and outputs the 
video data with frames by using the data multiplexing control signal li to 
the data output terminal 20. And the data output terminal 20 outputs 

20 the output data 25 ( la ). 

Next, the case, in which the audio input switch signal 21 ( lj ) 
is ON (H level), is explained. First, the audio signal detector 17 detects 
audio levels of the audio input signals 22. When the audio detected 
signal 23 ( le ) is in the state Si, at the same as the state So mentioned 

25 above, the encoded video data lb from the video data encoder 13 are 
written in the video data storage 15 by the data write control signal Id 
from the audio signal detector 17. Writing operation of the encoded 
audio data lc to the audio data storage 16 from the audio data encoder 
14 is stopped. The multiplexing controller 18 makes the video data 

30 storage 15 read out the smoothed video data If to the multiplexer 19 by 



using the data read control signal lh based on the audio detected signal 
le, and also outputs the data multiplexing control signal li to the 
multiplexer 19. The multiplexer 19 generates the framing signal 24 ( 
d ) that adds the video and/or audio identification signal to the header of 
5 the data and generates frames and outputs the video data with frames by 
using the data multiplexing control signal li to the data output terminal 
20. And the data output terminal 20 outputs the output data 25 ( la ). 

As mentioned above, when the state S is only So or Si, the 
output data are only video data as shown in ( f ) in Fig. 3. 

10 And when the audio detected signal 23 ( le ) is in the state S2, 

the encoded video data lb from the video data encoder 13 are written in 
the video data storage 15 by the data write control signal Id from the 
audio signal detector 17. And also the encoded audio data lc being a 
low bit rate from the audio data encoder 14 are written in the audio data 

15 storage 16 by the data write control signal Id from the audio signal 
detector 17. The multiplexing controller 18 makes the video data 
storage 15 read out the smoothed video data If and also makes the audio 
data storage 16 read out the smoothed audio data lg to the multiplexer 
19 by using the data read control signal lh based on the audio detected 

20 signal le, and also outputs the data multiplexing control signal li to the 
multiplexer 19. The multiplexer 19 generates the framing signal 24 ( 
d ) that adds the video and/or audio identification signal to the header of 
the data and generates frames and outputs the video and audio data 
with frames by using the data multiplexing control signal li to the data 

25 output terminal 20. And the data output terminal 20 outputs the 
output data 25 ( la ). At the case that the state S is only S2, the output 
data are shown in Fig. 3(g). 

And when the audio detected signal 23 ( le ) is the state S3, the 
encoded audio data lc being a high bit rate from the audio data encoder 

30 14 are written in the audio data storage 16 by the data write control 



signal Id from the audio signal detector 17. And writing the encoded 
video data lb to the video data storage 15 from the video data encoder 13 
is stopped. The multiplexing controller 18 makes the audio data 
storage 16 read out the smoothed audio data lg to the multiplexer 19 by 

5 using the data read control signal lh based on the audio detected signal 
le, and also outputs the data multiplexing control signal li to the 
multiplexer 19. The multiplexer 19 generates the framing signal 24 ( 
d ) that adds the video and/or audio identification signal to the header of 
the data and generates frames and outputs the audio data with frames 

10 by using the data multiplexing control signal li to the data output 
terminal 20. And the data output terminal 20 outputs the output data 
25 ( la ). At the case that the state S is only S3, the output data are 
shown in Fig. 3(h). 

As shown in Fig. 2, at step A14, the output data are shown in 

15 the cases that the mentioned above state S is So, Si, S2, or S3. With this, 
at the data transmission system using at cellular phones of the present 
invention, transmission lines in an existing transmission capacity can be 
used efficiently, and the quality of video and audio data to be transmitted 
can be improved. 

20 As mentioned above, at the data transmission system using at 

cellular phones of the present invention, an audio signal detector is 
provided. And when the audio signal detector detects audio signals 
exceeding a designated audio level for over a designated time while video 
data are transmitting, transmission of audio data starts by a low bit rate, 

25 and multiplex telecommunication of the video data and the audio data is 
executed. With this, it is avoided that the transmission of the video 
data is stopped by a single sound. And at this state, when different 
audio signals exceeding another designated audio level are detected for 
over another designated time, the transmission of the audio data is 

30 executed by a high bit rate and the transmission of the video data is 



stopped, with this, the audio quality is improved. As mentioned above, 
the telecommunication control of the video data and the audio data to be 
transmitted is executed based on the changes of audio levels of inputted 
audio signals in the passage of time. Therefore, transmission lines in 

5 an existing transmission capacity can be used efficiently, and the quality 
of video and audio data to be transmitted can be improved. 

While the present invention has been described with reference 
to the particular illustrative embodiment, it is not to be restricted by that 
embodiment but only by the appended claims. It is to be appreciated 

10 that those skilled in the art can change or modify the embodiment 
without departing from the scope and spirit of the present invention. 



